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Introduction 

Upon thè publication of thè annoimcement for thè participation (7* 
November 2011) in thè Framework for Research Quality Assessment 
2004-2010 (VQR 2004-2010), published by Agenzia di Valutazione 
del Sistema Universitario e della Ricerca (ANVUR), it began to op¬ 
erate a complex organisational process which aim is to assess a 
representative sample of thè scientific production of Italian Universi- 
ties within thè last 10 years.^ The importance of research assessment 
exercise (RAE according to thè English definition) in thè area of sci¬ 
entific research products (articles, books, patents, etc.) has increased 
consisfenfly in fhe firsf decade of fhe new century (an infroducfion 

^The organisation and thè management of thè assessment framework are detailed 
in thè founding decree of ANVUR (DPR n. 76 of thè February thè 1®* 2010) and in 
DM of July thè 12* (http://www.anvur.org). The text announcing thè participation 
cali is available at: http://www.anvur.org/sites/anvur-miur/files/bando_vqr_def_ 
07_ll.pdf. 
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to thè topic can he foimd in Baccini, p. 11-35; De Robbio). Recently, 
in addition to thè Research Quality Assessment 2004-2010 launched 
in Italy, thè English Research Excellence Eramework (REE) 2009- 
2014^ and thè Excellence in Research for Australia initiative (ERA) ^ 
launched in 2010 bave to he mentioned. The govemments became 
ever more careful in establishing precise criteria for awarding funds 
for research, fhus making fhe scienfific insfifufions more funcfional, 
sfimulafing a greafer efficiency of research, allocafing resources on 
thè basis of merit, and demonsfratmg fhat invesfments produce a 
common good (Abramo, D'Angelo, and Di Costa, p. 929-941). The 
most debated issue is, of course, what thè evaluation criteria are. 
Unique criteria or different criteria for different areas? Qualifative 
criteria (peer review) or quantitative criteria (Impact Eactor, etc)? 
Bibliography conceming this topic increased exponentially in thè 
last decades (for a hisforical reconsfrucfion of bibliomefrics and cur- 
rent debate see De Bellis). In thè follwoing pages we mean to prò vide 
a paper analyzing thè space reserved to Italian journals in thè field 
of Humanities and Social Sciences within thè main bibliographic 
tools used for thè evaluation of research (for more mformation on 
thè topic see Graziosi, p. 31). We will concentrate on bibliographic 
databases such as Web of Science and Scopus.^ We believe it is im- 
portant to deepen thè knowledge on these topics that is not currently 
developed, through a basic presentation of thè main aspects of fhe 
issue. Dafa on Ifalian journals, drawn from thè chosen databases, 
are goingo to he entirely presented and subjected to criticai exami- 
nation. Web of Science (WoS), creafed by Thomson Reufers (already 


^http://www.hefce.ac.uk/research/ref/. 

^http: / /www.arc.gov.au/era/ . 

^ANVUR explicitly indicates thè two databases in its document "Criteri e 
parametri di valutazione dei candidati e dei commissari dell'abilitazione scien¬ 
tifica nazionale", 22’^'^ June 2011, http://www.anvur.org/sites/anvur-miur/files/ 
documento01_ll.pdf 
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part of thè Institute for Scientific Information ISI), is an Online bib- 
liographic commercial database (it contains full fexf arficles and 
absfracfs) accessible fhrough fhe Web of Knowledge porfal/, and if 
is arficulafed in fhree secfions (Science Citation Index, Social Science 
Citation Index, Arts & Humanities Citation Index). WoS aims fo selecf 
journals from differenf disciplmes wifh rigorous criferia.^ Relafed 
fo WoS is fhe Journal Citations Reports (JCR) which gafhers more 
fhan 10,000 journals belonging fo more fhan 230 disciplinary areas, 
published by more fhan 2,000 publishers. JCR is used as a fool fo 
compare and evaluafe journals. JCR uses bibliomefric indicafors, 
some fradifional like Impaci Factor (IF) and Five-year IF, fo ofhers 
fhat are considered new metrics such as fhe Eigenfactor, efc. The an- 
nual edition contains data related to thè publications of thè previous 
year. JCR is available in two editions: JCR Science Edition covering 
more than 8,073 journals, and JCR Social Science Edition with 2,731 
journals.^ The other data source considered for fhis sfudy is Scopus, 
an initiative launched by Elsevier in 2004.® Scopus is a bibliographic 
commercial lisi fhaf - compared fo WoS - is more exfensive when if 
deals wifh languages and counfries of publicafion of fhe journals 
scope of this sfudy. Furthermore, it contains a larger number of jour¬ 
nals belonging to thè SSH (Social Sciences and thè Humanities) area 
(see table 1).® Our analyses are based on thè free access database 
Scimago, created in collaboration between some Spanish universi- 
ties and thè publisher Elsevier in 2007. The bibliometric indicator 
developed by Scimago is thè Journal Rank Indicator (SJR), whose 


®http://wokinfo.com/125 

^http://wokinfo.com/products_tools/multidisciplmary/webofscience/. 
^http://thomsonreuters.com/products_services/science/science_products/ 
a- z / journal_citation_reports /. 

*http://www.scopus.com. 

®Tables are available as a separate file at http://leo.cilea.it/index.php/jlis/article/ 
downloadSuppFile/4787/180. 
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sources are thè journals indexed by Scopus starting from 1996. SJR 
is thè main competitor of IF used by thè Journal Citation Report 
(WoS). SJR is developed with thè algorithm Google PageRank and, 
besides calculating thè impact by journal, it calculates thè impact by 
Country using thè function Country Rank. SJR was developed by 
Félix de Moya from thè Consejo Superior de Investigaciones Cien- 
tificas (Spain) and by Vicente Cuerrero Bote from thè Universidad 
de Extremadura (Spain) (for further readings see Conzalez-Pereira, 
Cuerrero-Bote, and Moya-Anegón, p. 379-391). The results of thè 
analyses are available free of charge on thè SCImago Website. 


Methodology 

This paper examines thè journals (excluding books, reports, etc.), 
part of thè two above-mentioned indexes, responding to thè fol- 
lowing characteristics. They bave: a) to he published in Italy (not 
exclusively in Italian language); b) to belong to SSH area. For a better 
identification of thè journals in thè list we referred to thè ISSN of 
thè review. Data are taken from three sources: a) thè Journal Citation 
Reports (JCR) of WoS with reference to JCR Social Sciences edition for 
thè year 2010. The examrnation of JCR was carried out using thè 
Online access made available by thè Library Services Center of thè 
Università degli Studi di Perugia; b) thè Arts& Humanities Citation 
Index (A&HCI) of WoS for thè year 2010. WoS does not calcolate thè 
IF of thè journals. The examination of this bibliographic database 
will serve to enrich thè information on thè consistency of thè pres- 
ence of Italian journals in WoS, provided that it cannot he used for 
evaluation purposes. The examination of thè A&HCI was carried 
out using thè Online access made available by thè Library Service 
Center of thè Università degli Studi di Perugia; c) SCImago Journal 

/ / www.scimagojr.com/ . 
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& Country Rank (SJR). Searches on SJR was restricted to subject 
areas: Arts and Humanities and Social Sciences for thè year 2010. SJR 
shows bibliometric indicators even for Humanities journals. The last 
examination of SJR was made through thè portai SCImago Journal 
& Country Rank in January 2012. We took into account also thè in- 
formation available on thè officiai websifes of fhe fwo bibliographic 
databases and thè most important bibliographic papers on thè topic. 
For thè differences between JCR and SJR we take as a reference a 
selection from thè vast literature on thè subject (there are many pa¬ 
pers suggesting a comparative analysis between thè two data bases, 
among which we indicate: Deis and Goodman, p. 5-21; Jacsò, "ISI 
Web of Science, Scopus, and SPORTDiscus", p. 51-54; p. 1537-1547; 
La Guardia; Tarantino, p. 23-32; Anegòn et al., p. 53-78). 


The data 

In this section we will present thè collected data and their criticai 
analysis. We consider appropriate to show in full fhe dafa obfained 
from fhe research on fhe bibliographic dafabases. The presentation 
of dafa should be considered as an integrai part of thè paper and 
aims to promote a better understanding of thè proposed analysis,in 
order to help understanding thè functioning of thè databases and 
thè bibliometric indicators which are being used, and finally to allow 
those who are interested (scientists, evaluators, librarians, etc.) to 
study in depth thè issue. Data are summarized in tables 2 to 12. 
Table 2 shows, in alphabetic order, thè Italian journals present in JCR 
Social Science Edition 2010.^^ The Italian journals in thè section Arts 

^'JCR is available in two editions: JCR Science Edition and JCR Social Science 
Edition. Each annual edition contains data related to thè publications of thè previous 
year, and shows connection between thè journals with citations and citing journals in 
a simple and easy to use way 
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& Humanities Citation Index 2010 are listed in table 3, in alphabetic 
order as well. Table 4 shows Italian journals in SJR Social Sciences 
2010 and table 5 contains Italian journals in SJR Arts & Humanities 
2010. The three following tables show Italian position (in terms of 
number of publications) in thè world rankings (2010) calculated by 
SJR, respectively in thè area of Humanities (table 6), in thè area of So¬ 
cial Sciences (table 7), and in all disciplines (table 8). Table 9 outlines 
thè position of Ifaly in ferms of number of publicafions, as lisfed in 
WoS (dafa are relafed fo thè year 2010). The Venn's diagram (fig. 1 
on page 9) represents thè total number of Ifalian journals belonging 
fo all fhe disciplines lisfed in Scopus and WoS. The lasf fwo fables 
(10,11) compare Italian journals of thè Humanities area and those of 
Social Sciences presenf bofh in JCR and SJR (2010). Scopus includes 
nof only a large collection of journals (18.854 compared to 10.804) 
buf also a greaf number of represenfed counfries (231 compared fo 
84) and a great (50 compared to 45) language variety (see table 1). 
The journals published in languages other than English are actually 
underrepresented in both databases. Chronological coverage of Sco¬ 
pus is less extensive than thè one of WoS. Concerning to bibliometric 
indexes, thè two databases use different tools. SJR indicator, for 
instance, assumes that not all thè citations are equal, therefore it 
introduces a careful consideration based on thè prestige of thè citing 
joumal and excludes self-citation. In thè 2010 JCR Social Science 
edition, 13 Italian journals were indexed: they represent 0.47% of 
fhe tofal number of thè listed reviews (2,731). The percentage of 
fhe journals published in fhe Unifed Sfates and England, indexed 
by JCR, is respectively 45% and 26.3%. Therefore thè journals of 
fhose geographical areas represenf 71.3% of fhe fofal. Eurfhermore 
fhe presence of Italian journals turns out to be reduced compared to 
other European nations. Eor instance, there are 52 Spanish journals 
which equals to 1.90% of fhe fofal number of journals in JCR Social 
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Sciences, and 25 French journals corresponding to to 0. 91%. We 
should keep in mind that JCR adopts its own criterion of disciplinary 
classification which includes medicai journals among Social Sciences 
publications (table 2). We are going to take into account now thè 
Impact Factor (IF) and thè five-year IF of some Italian journals which 
are present in thè table 2}^ The Impact Factor of fhe Journal of 
Anthropological Sciences of thè Italian Anthropological Institute 
(Istituto Italiano di Antropologia) equals to 2.000 and guarantees to 
thè journal thè seventh place (of 76) among fhe journals belonging 
fo fhis area and indexed by JCR. The journal wifh fhe highesf IF in 
this category is Evolufionary Anthropology wifh thè vaine 4.531. 
Cadmo, Italian journal of experimenfal pedagogy, is posifioned 166 
(of 184) in thè category Education & Educational research with lE 
equal to 0.160. The journal with thè highest IF in thè same category 
is Educational Research (USA) with lE 3.774. Economia Politica 
records an IF equal to 0.610, not a very high level in thè area of Eco- 
nomics. The Journal of Economie Literature (USA) is positioned first 
with an IF equal to 7.432. Nuncius. Journal of thè History of Science 
(cafegory of Hisfory and Philosophy of Science) has an IF vaine of 
0.080, while thè highest vaine (3.986) in this category was attributed 
to thè US journal American Journal of Bioethics. The journal belong¬ 
ing fo fhe Social Science Edifion 2010 wifh thè absolute highest IF is 
thè English Behavioural and Brain Sciences (21.952). We underline 
that History and Philosophy of thè Life Sciences, edifed by Sfazione 
Zoologica Anfon Dohm from Naples, published by an Ifalian pub- 

^^The authors remind readers that annual IF (in this case thè 2010) is calculated by 
dividing thè number of citations received by journals in 2010 on thè articles published 
in 2008 and 2009 by thè overall number of articles published during those two years. 
The five-year IF (for a five-year period) corresponds instead to thè average number 
of times thè articles of thè journals published in thè last live years were cited in JCR 
year, in our case 2010. This measuring parameter, available only from JCR 2007, is 
used to better analyse thè impact of thè journals in thè areas where thè influence of 
public research is developed for a greater period of time. 
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lisher (F. Giannini, Napoli), was noi included among thè thirteen 
Italian journals, but among thè English journals. This inconsistency, 
although rare, reveals thè need for an examination of thè use of clas- 
sification criteria adopted by databases. Arts & Humanities Citation 
Index (A&HCI) of WoS analyses thè humanities related publications 
(with abstracts and bibliographic information), but does not offer 
instruments for bibliometric measurement. A&HCI 2010 indexed 
1679 journals out of which 63 Italian equal to 3.75% of thè total (table 
3). We underline a considerable percentage rise of thè relevance of 
Ifalian journals in A&HCI compared fo JCR Social Sciences. During 
2010, SJR Social Sciences (Scopus) indexed 2,958 journals in fhe so¬ 
cial Sciences area, ouf of which 1.14% (34) are Ifalian (fable 4); while 
1,638 are journals belonging to thè area of humanifies ouf of which 
55 are Italian, equal to 3.35% (table 5). The total of Italian journals 
(and other kinds of material) in thè database is 323, that is 1.71% 
of thè total number of indexed documents (18,854). It should he 
noted that, imlike WoS, Scopus began indexing also monographs 
and series as a recent insertion in its database of thè titles belonging 
to thè European Reference Index for Humanities (ERIH) of Euro- 
pean Science Foimdation shows.^^ The tables 4 and 5 show fhe lisf 
of Italian journals included in humanishc and social Sciences area 
of SJR Social Sciences even in order to facilitate their identification. 
The title of a single journal was flanked by ISSN and thè values of 
thè following indicators: total cites,^'^ SJR, h-Index,^^ In thè 2010 

^^Scopus Works with European Science Foundation to expand Arts and Humani¬ 
ties coverage, http: / / www.elsevier.com/ wps/find/authored_newsitem.cws_home/ 
companynews05_01241. 

^^Scimago total cites is an indicator which gathers thè total of citations received in 
other articles published in a journal in thè last three years. 

^®H-mdex is an index elaborated by Jorge E. Hirsch ( University of California) 
in order to measure both productivity and impact of thè work of thè scientists, on 
thè basis of thè number of their publications and thè number of citations they have 
received in other publications. Hirsch's defrnition is as follows: a scholar has an h- 
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ranking drawn up by SJR, Italy holds eighth position (of 146 coun- 
tries) regarding publicatìon of documents (articles etc.) belonging 
to thè area of humanities, preceded by thè United States, United 
Kingdom, France, Canada, Germany, Australia and Spain^^ (table 6). 
In thè social Sciences area, our country takes eleventh position out of 
195 (table 7). Regarding all thè areas, it is positioned eighth among 
231countries (table 8). In order to make thè comparison easier, we 
have shown in table 9 thè level of Italian journals presence within 
WoS regarding thè disciplinary areas which are subject matter of 
this paper. The followrng tables, as specified, have a comparative 
purpose. The diagram of Venn (fig. 1) represents thè total number of 
Italian journals, which belong to all disciplinary areas, in thè Scopus 
database (323) and in WoS (197). In reality, thè total number of jour- 



Figure 1: Italian journals present in Scopus and WoS 


nals represented in thè two databases, as thefollowing data show. 


index 50 il he has 50 articles with at least 50 citations each. 
i6www.scimagojr.com/countryrank.php 


4787-9 









A. Capaccioni, Italian SSH journals in JCR and S}R ... 


is 386. The results in detail: shared journals, (those present in both 
databases) are 134; thè journals present exclusively in one database 
are respectively 189 in Scopus and 63 in WoS. These data confirm 
a greater coverage of thè Italian production by Elsevier (Scopus). 
The table 10 compares thè bibliometric values of thè 13 journals that 
can he found in both databases, even if they are placed in different 
disciplmary areas. While in WoS all journals are classified in thè 
area of Social Sciences, in Scopus thè same journals are collocated in 
different areas: nine journals are placed in medicai area, thè remain- 
ing tour are inserted into thè Social Sciences one (Cadmo, Economia 
Politica, International Journal of Transport Economics, Journal of 
Anfhropological Sciences). Einally, fhe fable 11 shows fhe journals 
present both in Arts & Humanities Citation Index (bibliometric vaine 
not calculated by thè producer) and in SJR Arts & Humanities 2010 
(with bibliometric vaine). 


Conclusion 

The issue of fhe space reserved to fhe scienfific production of 
Humanifies and Social Sciences areas in bibliographic dafabases 
has fwo main aspects: a generai level relafed fo fhe bibliometric 
topics and to thè evaluation policies, and a more specific one which 
deepens thè adequacy of bibliographic instruments (databases, jour- 
nal classifications and indexes, etc.) used at present in evaluating 
processes. In thè first case, during thè last few years fhere has been 
a crificism regarding fhe use of unique criteria of evaluafion for 
both Hard Sciences and Humanities and Social Sciences. In this 
way thè claim of superiorify of fhe former Sciences over thè latter 
ones actually fails, since thè comparison is done with non adequate 
parameters. In a recent paper, Andrea Bonaccorsi (of fhe Executive 
Council of ANVUR) explained how thè literature on thè subject 
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has now become aware of a differentiated use of evaluating criteria 
(Bonaccorsi). It is high time for us to suppuri thè search for crite¬ 
ria capable of understanding with a greater coherence thè values 
expressed by scientific production of Humanisfic and Social area. 
An clear example is fhe debafe on fhe f 5 ^ologies of scienfific prod- 
ucfs, in parficular on monographs. Bibliographic dafabases pay 
very liffle affenfion fo monographs, and we could nofice if even 
wifh fhe producfs considered for fhis arficle. The main dafabases 
involved in fhe evaluafion acfivify fend fo overesfimafe fhe role of 
fhe arficle, supporfing insfead fhose disciplinary areas, parficularly 
ones belonging fo hard Sciences, fhaf now have ceased fo resorf 
fo fhe monographic sfudies. Paradoxically, Bonaccorsi confinues, 
every bibliomefric acfivify achieved wifh fhe presenf criferia would 
resulf "futile, because it would measure a marginai part of Humani- 
fies producfion (arficles in journals), leaving complefely unchanged 
fhe monographic producfion". During a recenf seminar enfifled 
University Research and its Evaluation organized by Università Cat¬ 
tolica (Milano, 28 settembre 2011), Edoardo Barbieri and Giovanni 
Solimine presented a decalogue on research evaluation in thè area of 
Humanifies (Barbieri). Talking abouf monographs, fhe fwo scholars 
poinfed ouf fhaf "for Humanifies and Social Sciences, fhe scienfific 
journal - on which impaci indicafors are fradifionally based - is noi 
fhe mosf popolar f 5 ^e of publicafion, or however if is noi fhe only 
one. Alongside papers on scienfific journals, fhese disciplines com- 
monly use fhe specialized monograph, which is fhe mosf common 
fype of publicafion and which does not coincide with thè production 
of manuals. Among thè different types of monographs, some sectors 
privilege fhe edifions of fesfs (accompanied by an adequafe philo- 
logical apparafus and/or a commenf), fhe edifing of invenfories 
and cafalogues, fhe records of con venti ons and symposia" (, p. 34). 
The evaluafion acfivifies of Humanifies and Social disciplines shall 
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therefore take into account some specific elements, and particularly 
thè extensive use of thè monograph format. There are, as mentioned 
in thè paper, positive signs of change in frends which give us hope. 
A cautious opening by thè bibliographic databases producers to- 
wards monographs, especially Elsevier (Scopus), can be noted, too. 
The producers of dafabases follow fhe debafe on fhe scienfific pro¬ 
duction evaluation, and they bave realised that thè competition is 
getting keener. Until thè beginning of fhe new cenfury, WoS was 
almosf fhe sole bibliographic tool used in evaluafion processes, buf 
wifh fhe infroducfion of Scopus (2004) fhis supremacy was reduced. 
We should fake info account that during thè last decade, National 
authorities in charge of research policy increased thè demand for 
more reliable evaluation tools. The current crisis has made urgent a 
selection of worfhy academic and research insfifufions in order to 
take thè maximum advantage of an ever reduced funding. These are 
fhe main reasons thaf urged bibliographic dafabases producers fo 
consider fhe enlargemenf of fhe number of analyzed producfs. The 
studies fhat infend fo analyse thè compliance of single dafabases 
wifh fhe requiremenfs of evaluafive acfivifies are placed on a more 
specific level. From fhe dafa and fhe analyses exposed in fhe pre- 
vious paragraph a substanfial confirmafion of a generai condifion 
of poor inferest towards Humanities and Social Sciences emerges, 
as well as fhe presence of some less negative signals. In WoS, Hu¬ 
manities make up 15.2% of fhe enfire dafabase and in Scopus 8.68%. 
Neverfheless, we can nofe fhaf Ifalian journals which belong fo fhe 
area of Humanities and Social Sciences are in a satisfactory posi- 
tion. In SJR Social Sciences, Italian scientific production takes eighth 
place (table 6) in country ranking, confirming thè same position that 
Italian scientific production holds as a whole (all thè disciplines) 
within thè same database (table 8). A better result is registered 
in WoS. Table 9 shows how Italian Humanities journals, again in 
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country ranking, gain a better position (sixth position) compared 
to thè Social Sciences journals (eleventh position) and to thè jour- 
nals of all disciplinary areas (eleventh position). In a recent paper 
Emanuela Reale, revising thè data of Erawatch-Metris, confirmed 
thè conflicting signals regarding Italian scientific production in thè 
area of Humanifies and Social Sciences (Reale, p. 21-22). Reale em- 
phasized fhe increase of fhe fofal number of Ifalian publicafions in 
thè area of social Sciences and humanities: from 32547 works in 2000 
we moved fo 43758 in 2006. The number of publicafions records an 
average increase of 7.2% (compared fo 1.5% of Trance, 5.9% of Ger- 
many, 3% of Great Britain, only Spain has a befter performance with 
11%).^^ The scholar also emphasized a safisfacfory affirmafion of 
thè overall Italian production which for thè 2006 reached 10% of thè 
sector's total, against 19.4% of Great Britain, 18% of Germany, 12.4% 
of Trance. The overall Ifalian producfion "in SS rndexed journals" 
furns ouf fo be sfili low and inferior in absolufe values compared fo 
ofher European counfries resulfs. This is also confirmed by fhe facf 
fhaf fhe "quofa of Ifalian SS publicafions compared fo fhe fofal of 
fhe dafabase ISl-Thompson is 3%, againsf a vaine EU27 of 5%" (, p. 
21). Even recenf researches of Ginzia Daraio, dedicafed fo Ifalian 
scientific production as a whole and calculated over a longer period 
of fime (1980-2007, sources WoS and EUROSTAT), confirm fhaf fhe 
annual growfh rafe has a fendency fo be higher compared fo fhe 
marn European countries (except Spain). However affer 2007, "when 
fhe global percenfage of Ifalian journals was 3.5%, a slighf decrease 
in Italian scientific production was noted, with 3.4% in 2008 and 3.3% 
in 2009" (Daraio, p. 38; Daraio and Moed p. 1380-1392). According to 
Daraio, "in thè year 2000 Italy reached thè world average in terms of 
quality of ifs scienfific producfion, measured by normalized relafive 

^^For more information about Spanish situation see Gonzàlez-Alcaide ("Anàli- 
sis del proceso de internacionalización de la investigación espanola en ciencia y 
tecnologia (1980-2007)"). 


4787-13 



A. Capaccioni, Italian SSH journals in JCR and S}R ... 


impact of citations; however its level is lower than thè one of thè 
mairi European countries (Switzerland, Netherlands, Great Britain, 
Germany, France)" (Daraio, p. 39). In view of thè foregoing, it is 
evident how bibliometric instruments, particularly those taken in 
consideration on this occasion, do not represent Humanities and So¬ 
cial Sciences disciplinary areas in an adequate way. Alberto Baccini, 
summarizing thè results of Henk F. Moed's research put together in 
a sfudy dedicated to thè analysis of thè adequacy of databases for 
scientific evaluation (Moed), showed that thè level of coverage of 
ISI for Humanities and Social Sciences should be considered "mod¬ 
erate", that is thè lowest among all thè disciplines (Baccini, p. 88-97, 
in part. 97). The Italian Agency of Evaluation (ANVUR) takes these 
limits into account, and in a recent document it limit thè recourse to 
bibliometric analysis to few disciplinary sectors of Humanities and 
Social area (ANVUR; ANVUR, GEV 11). The validity of criticism 
fowards thè application of bibliometric methods to Humanities and 
Social disciplines canno! justify thè avoidance, by many scientific 
sectors, of evaluation activities. The last observation highlights an- 
other aspect: thè inadequacy of cultural approach of thè majority 
of professors when it comes to evaluation issues. Baccini points thè 
finger at thè poor attention by thè Italian university environment 
when it comes to these problems, and at thè poor interest by editorial 
committees in seeing their own journals included in intemational 
bibliographic databases (Baccini, p. 92). 

What are thè suggestions for thè future? On a generai level 
we believe it is a priority to increase thè commitment to improve 
bibliometric instruments, making them more responsive to thè char- 
acteristics of thè Humanistic and Social area products. In this sense, 
precious indications can be found on thè already cited documents 
elaborated by thè Groups of evaluation experts (GEV) of ANVUR, 
which describe thè criteria used for evaluation of research products 
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subjected by Italian Universities to VQR 2004-2010 (29 February 
2012) and thè report of Andrea Bonaccorsi (7 March 2012). From thè 
latter text we get an exhortation to experiment rndicators which are 
not exclusively based on citations analysis, for example: indicators 
of utilization (Journal usage factor), indicators of availabilify in cafa- 
logues, web based usage indicators, reviews of monographs. On fhe 
bibliographic dafabases specific level, we rafher fhink if is impor- 
fanf fo acf in fwo direcfions. Bibliographic insfrumenfs (dafabases, 
journals classificafions and ediforial series, efc.) orienfed fowards 
Humanifies and Social Sciences producfion in European confexf 
should be identified and developed. Among fhe endeavours already 
in progress, fhe following deserve fo be pornfed ouf: fhe Spanish 
Clasificación infegrada de revisfas cientificas (CIRC), wifh its second 
edifion (2011/2012) edifed by differenf insfifufions (CCHS-CSIC, 
le universifà di Navarra, Granada, Carlos III di Madrid, la Fun- 
dación Dialnef) and independenf from nafional agencies of evalua- 
tion CNEAI and ANECA/® and fhe French index, which is currently 
being adjusted, created by Agence d'evaluation de la recherche et de 
Fenseignement superieur (AERES).^® In thè area of cooperafion we 
poinf out fhe European reference index for fhe humanifies (ERIH), 
whose aim is fo increase fhe visibilify of fhe journals in fhe area of 
humanifies published in all fhe languages of European Union. ERIH 
index is rim by European Science Foundafion (ESF), an rnsfifufion 
esfablished in Strasbourg in 1974 with thè aim to improve European 
cooperation in thè area of research.^® 

In fhis phase we should considerate counferproductive fo foresee 
fhe abandonmenf of insfrumenfs such as WoS and Scopus. Even 

^*http://epuc.cchs.csic.es/circ/categorias.html 

^®http://www.aeres-evalua tion.fr/Publications/Methodologie-de-l-evaluation/ 
Listes- de- re vues- SHS- sciences-humaines- et- sociales 

^^http : / / www.esf. org / research- areas / humanities / 
erih-european-reference-index-for-thè-humanities/erih-foreword.html 
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with their limita tions, they remain an international point of reference 
for evaluation activities. Actions of reinforcement of fhe posifion 
of Ifalian language journals are fo be pursued, perhaps favouring 
weaker disciplinary secfors wifhin dafabases. ANVUR, leaming 
from some infernafional experiences, announced some inifiafives 
going in fhe righf direcfion. We will examine some of fhem. The 
nafional agency of evaluafion decided fo organise acfivifies fo sup- 
porf "candidacy of a solid group of Ifalian language journals which 
safisfy ediforial requiremenfs accepfed af infernafional level for fhe 
purpose of indexafion in ISI and Scopus" (Bonaccorsi). During fhe 
firsf phase will be sysfemafically verified fhe requiremenfs for fhe 
access fo thè databases of Italian journals already indicated in group 
A (and in some cases in group B) by GEV. ANVUR will take into 
consideration thè experience of fhe Ifalian journals, in fhe humani- 
fies and social Science area, which have already gained access fo ISI 
and Scopus. For fhis purpose we poinf ouf fhaf fhis essay, devised 
also as a clusfer of dafa, can provide a baffer acquainfance wifh fhis 
realify. The same agency, once fhe lisf of fhe journals candidafes 
will be esfablished, will offer logisfic and organisafional supporf 
fo handle fhe falks wifh fhe producers of dafabases. ANVUR will 
also commi! itself to determine thè right modality of monitoring thè 
scientific quality of monographs (Bonaccorsi). A sfudy group will 
be esfablished, in collaborafion wifh Ifalian Associafion of Edifors 
(AIE), in order fo elaborafe "a grid of indicafors aimed af affirming 
fhe modalify wifh which fhe edifors should manage fhe submission 
and fhe selecfion of manuscripfs". Even in fhis case fhe proposai 
is posifive, and could be exfended af fhe journals' managemenfs. 
The cerfificafion of fhe review (peer review) has now become an 
essential acfivify. If can be guaranteed fhrough fhe fraceabilify of all 
fhe stages of thè evaluation activity: from a requesf for public funds 
fo a fransparenf managemenf of fhe lisfs of reviewers, fo fhe care 
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for thè anonymous nature of thè review process. There are by now 
standardized procedures and authoritative guidelines, just think of 
recent European Peer review Guide (2011) of thè European Research 
Foundation/^ which can he adopted or suggested as reference crite- 
ria. 


^^http://www.esf.org/activities/mo-fora/peer-review.html 
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Abstract: Aim of this paper is to give a contribution to thè analysis of thè visibility 
gave to thè Italian Humanities journals from leading bibliographic databases used 
for national research assessment. In particular, we will focus on thè bibliographic 
databases Web of Science (Thomson Reuters) and Scopus (Elsevier). We believe it is 
important to develop a deep understanding of thè issues related to assessment. We 
would like to deal with these issues, not yet adequately discussed by Italian scholars, 
through an essential statement of thè main aspects of thè problem. Therefore, we 
propose an examination of detailed lists of Italian Humanities journals included in 
thè selected databases to help thè identification of titles. Then is given a criticai 
analysis of thè data. 

KeywordS: Bibliographic databases; Bibliometrics; Research assessment; Scopus; 
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